Papers with information extraction
Human-in-the-loop Schema Induction (2023.acl-demo)
Copied to clipboard
Tianyi Zhang, Isaac Tham, Zhaoyi Hou, Jiaxuan Ren, Leon Zhou, Hainiu Xu, Li Zhang, Lara Martin, Rotem Dror, Sha Li, Heng Ji, Martha Palmer, Susan Windisch Brown, Reece Suchocki, Chris Callison-Burch
| Challenge: | Existing approaches to event-centric natural language understanding (NLU) have been limited to linear and temporal ones. |
| Approach: | They propose a human-in-the-loop schema induction system powered by GPT-3 . they show that it transfers to new domains more easily than previous approaches . |
| Outcome: | The proposed system transfers to new domains more easily than previous approaches and reduces human curation. |
Unveiling the Deficiencies of Pre-trained Text-and-Layout Models in Real-world Visually-rich Document Information Extraction (2026.findings-eacl)
Copied to clipboard
Chong Zhang, Yixi Zhao, Yulu Xie, Chenshu Yuan, Yi Tu, Ya Guo, Mingxu Chai, Ziyu Shen, Yue Zhang, Qi Zhang
| Challenge: | PTLMs have shown remarkable success in multiple information extraction tasks . however, their performance in real-world scenarios falls short of expectations . |
| Approach: | They propose to use an entity-centric dataset to evaluate PTLMs' performance . they find that inadequate annotations in benchmark datasets lead to spurious correlations . |
| Outcome: | The proposed dataset disentangles the falsely-coupled segment and entity annotations that arises from the block-level annotation of FUNSD. |
RFBFN: A Relation-First Blank Filling Network for Joint Relational Triple Extraction (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing methods for relational triple extraction ignore semantic information of relations or predict subjects and objects sequentially. |
| Approach: | They propose a relation-first blank filling network to capture semantic information of relations . they transform relations into relation templates with blanks which contain the fine-grained semantic representation of relations. |
| Outcome: | The proposed model outperforms current state-of-the-art methods on public benchmark datasets. |
Deep Learning on Graphs for Natural Language Processing (2021.naacl-tutorials)
Copied to clipboard
| Challenge: | Graph Neural Networks (GNNs) are powerful tools for non-Euclidean data modeling and are used in many graph-related NLP tasks. |
| Approach: | This tutorial will cover applying deep learning on graph techniques to NLP using Graph Neural Networks (GNNs) Graph4NLP is the first library for researchers and practitioners for easy use of GNNs for various NLP tasks. |
| Outcome: | This tutorial will cover the latest developments in deep learning on graph techniques and their applications in various NLP tasks. |
Discourse Analysis and Its Applications (P19-4)
Copied to clipboard
| Challenge: | Discourse processing is a suite of NLP tasks to uncover linguistic structures from texts at several levels, which can support many downstream applications. |
| Approach: | They present a set of tasks to uncover linguistic structures from texts at several levels, which can support many downstream applications. |
| Outcome: | The tutorial covers the basic concepts of discourse analysis and linguistic structures in monologue vs. conversation, synchronous v. asynchronous conversation, and key linguistic structure in discourse analysis. |
Cross-Task Instance Representation Interactions and Label Dependencies for Joint Information Extraction with Graph Convolutional Networks (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing work on information extraction (IE) has solved the four main tasks separately, thus failing to benefit from inter-dependencies between tasks. |
| Approach: | They propose a model to solve four IE tasks in a single model that captures inter-dependencies between tasks. |
| Outcome: | The proposed model achieves state-of-the-art performance on monolingual and multilingual learning settings with three different languages. |
Wikipedia as a Resource for Text Analysis and Retrieval (P19-4)
Copied to clipboard
| Challenge: | Tutorial examines the role of Wikipedia in tasks related to text analysis and retrieval. |
| Approach: | tutorial examines the role of Wikipedia in tasks related to text analysis and retrieval. |
| Outcome: | This tutorial examines the role of Wikipedia in tasks related to text analysis and retrieval. |
Deep Bayesian Natural Language Processing (P19-4)
Copied to clipboard
| Challenge: | Introduction to deep Bayesian learning for natural language addresses the fundamentals of statistical models and neural networks. |
| Approach: | This tutorial addresses the advances in deep Bayesian learning for natural language . it focuses on advanced Bayessian models and deep models . authors present case studies and domain applications to tackle different issues . |
| Outcome: | This tutorial focuses on advanced Bayesian models and deep models for natural language . case studies and domain applications are presented to tackle different issues in deep Bayessian processing, learning and understanding. |
Multi-modal Information Extraction from Text, Semi-structured, and Tabular Data on the Web (2020.acl-tutorials)
Copied to clipboard
| Challenge: | a tutorial explores the commonalities in the challenges and solutions developed to address information extraction from the World Wide Web. |
| Approach: | This tutorial examines methods for extracting information from the World Wide Web . it explores the commonalities in the challenges and solutions developed to address these different forms of text . |
| Outcome: | This paper examines the commonalities in the challenges and solutions developed to address the World Wide Web. |
Deep Reinforcement Learning for NLP (P18-5)
Copied to clipboard
| Challenge: | Many natural language processing tasks can be formulated as deep reinforcement learning (DRL) problems. |
| Approach: | This tutorial provides an introduction to the foundations of deep reinforcement learning . it describes recent advances in designing deep reinforcement for NLP . |
| Outcome: | This tutorial provides an introduction to the foundations of deep reinforcement learning and some practical solutions for NLP tasks. |
NESTLE: a No-Code Tool for Statistical Analysis of Legal Corpus (2024.eacl-demo)
Copied to clipboard
| Challenge: | a comprehensive statistical analysis of legal corpus requires specialized tools or programming skills. |
| Approach: | They propose a no-code tool for large-scale statistical analysis of legal corpus . NESTLE can extract any type of information that has not been predefined in the IE system . |
| Outcome: | The proposed tool can perform comparable to LexGLUE on 15 Korean precedent IE tasks and 3 legal text classification tasks. |
Trigger Word Detection and Thematic Role Identification via BERT and Multitask Learning (D19-57)
Copied to clipboard
| Challenge: | Using natural language processing to discover and mine drug-related knowledge from text has been a hot topic in recent years. |
| Approach: | They propose to use a pre-trained biomedical language representation model to extract mutation-disease knowledge from PubMed. |
| Outcome: | The proposed approaches achieve 0.60 (ranks 1) and 0.25 (rank 2) on task 1 and task 2 respectively in terms of F1 metric. |
Cross-lingual Zero Pronoun Resolution (2020.lrec-1)
Copied to clipboard
| Challenge: | In pronoun-dropping languages, predicate arguments are not realized instead of being realized as overt pronounos. |
| Approach: | They propose a BERT-based model for zero pronoun resolution in Arabic and Chinese . they also evaluate BERT feature extraction and fine-tune models on the task . |
| Outcome: | The proposed model outperforms the state-of-the-art model for Arabic and Chinese on OntoNotes 5.0. |
Text2DB: Integration-Aware Information Extraction with Large Language Model Agents (2024.findings-acl)
Copied to clipboard
| Challenge: | Current methods for information extraction (IE) focus on integrating IE output with the database . a long-overlooked question is what counts as "relevant knowledge" |
| Approach: | They propose a task that emphasizes integration of IE output and the database . they introduce a benchmark and an LLM agent framework for this task . |
| Outcome: | The proposed task integrates IE output and the target database (or knowledge base) it meets common demands such as data infilling, row population, and column addition . |
Making the Most Out of the Limited Context Length: Predictive Power Varies with Clinical Note Type and Note Section (2023.acl-srw)
Copied to clipboard
| Challenge: | Clinical notes have a long time span over multiple long documents. |
| Approach: | They propose a framework to analyze clinical notes with high predictive power . they propose to combine different types of notes to improve performance . |
| Outcome: | The proposed framework could be used to extract information from clinical notes . it shows that the sample size can be optimized for large contexts . |
Litigation Analytics: Extracting and querying motions and orders from US federal courts (N19-4)
Copied to clipboard
| Challenge: | a detailed manual analysis of a docket could provide valuable information for the suit and the respective judge. |
| Approach: | They applied machine learning and machine learning to extract and aggregate docket statistics . they used a search engine to query the data in real time and a question-answering interface . |
| Outcome: | The proposed method extracts information from 8 million federal dockets and keeps up with newly closed docketes. |
A Novel Approach to Part Name Discovery in Noisy Text (N18-3)
Copied to clipboard
| Challenge: | Part names are often multi-word terms longer than two words, and there is little consistency in how terms are described in noisy free text. |
| Approach: | They propose an algorithm that exploits statistical, linguistic and machine learning techniques to discover part names in noisy text. |
| Outcome: | The proposed method outperforms existing methods significantly in part name extraction. |
CharacterGPT: A Persona Reconstruction Framework for Role-Playing Agents (2025.naacl-industry)
Copied to clipboard
| Challenge: | Maintaining consistent character personas remains a significant challenge due to variability in information extraction. |
| Approach: | They propose a framework to dynamically reconstruct character personas through Character Persona Training. |
| Outcome: | The proposed framework is evaluated through Big Five personality evaluations and creative tasks, in which characters generate original narratives. |
Goodwill Hunting: Analyzing and Repurposing Off-the-Shelf Named Entity Linking Systems (2021.naacl-industry)
Copied to clipboard
| Challenge: | Named entity linking (NEL) is a preprocessing step in commercial systems . a small organization or individual could use an off-the-shelf system to accomplish the same objectives . |
| Approach: | They examine how to repurpose off-the-shelf NEL systems to correct sport-related errors. |
| Outcome: | The proposed model can improve sports question-answering accuracy by 25% . the proposed model is based on the best available model . |
ClinicalTrialsHub: Bridging Registries and Literature for Comprehensive Clinical Trial Access (2026.eacl-demo)
Copied to clipboard
Jiwoo Park, Ruoqi Liu, Avani Jagdale, Andrew Srisuwananukorn, Jing Zhao, Lang Li, Ping Zhang, Sachin Kumar
| Challenge: | ClinicalTrialsHub consolidates clinical trial data from ClinicalTrial.gov and augments it by extracting and structuring trial-relevant information from PubMed. |
| Approach: | They propose a search-focused platform that consolidates PubMed data and extracts structured trial information. |
| Outcome: | ClinicalTrialsHub increases access to structured clinical trial data by 83.8% compared to ClinicalTrial.gov alone. |
Large Language Models for Scientific Information Extraction: An Empirical Study for Virology (2024.findings-eacl)
Copied to clipboard
| Challenge: | Scholarly communication in the digital age is facing significant challenges due to the overwhelming volume of publications. |
| Approach: | They propose to use Wikipedia infoboxes and structured Amazon product descriptions to create structured scholarly contribution summaries using text generation capabilities of LLMs. |
| Outcome: | The proposed model can be applied to complex IE tasks within terse domains like Science with 1000x fewer parameters than the state-of-the-art GPT-davinci. |
MiniChain: A Small Library for Coding with Large Language Models (2023.emnlp-demo)
Copied to clipboard
| Challenge: | Programming augmented by large language models (LLMs) opens up many new application areas, but also requires care. |
| Approach: | They introduce a tool for augmented programming that provides basic primitives for coding LLM calls. |
| Outcome: | The proposed tool provides core primitives for coding LLM calls and separating out prompt templates. |
PLAtE: A Large-scale Dataset for List Page Web Extraction (2023.acl-industry)
Copied to clipboard
Aidan San, Yuan Zhuang, Jan Bakus, Colin Lockard, David Ciemiewicz, Sandeep Atluri, Kevin Small, Yangfeng Ji, Heba Elfardy
| Challenge: | Existing methods for web extraction are limited by the limited number of available large-scale datasets. |
| Approach: | They introduce a dataset that focuses on shopping data and a list page web extraction task. |
| Outcome: | The proposed dataset is the first large-scale list page web extraction dataset . it contains 52,898 items and 156,014 attributes, making it the first dataset based on this task . |
Computational Ad Hominem Detection (P19-2)
Copied to clipboard
| Challenge: | ad hominem attacks are introduced in debates as an easy win, but their impact on argumentation is limited . a machine learning approach to detect the personal attack is insufficient, we show . |
| Approach: | They propose a machine learning approach that detects ad hominem attacks using social media data . they propose TF-IDF approaches that are insufficient to detect the personal attack . |
| Outcome: | The proposed method has a recall of 80% for a social media data source. |
LED: A Dataset for Life Event Extraction from Dialogs (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for extracting life events from conversations are limited. |
| Approach: | They propose a dataset containing fine-grained life event annotations on conversational data. |
| Outcome: | The proposed dataset combines three information extraction frameworks to extract life events from conversations. |
SLOT: Structuring the Output of Large Language Models (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Structured outputs are essential for large language models (LLMs) but often deviate from predefined schemas hampering reliable application development. |
| Approach: | They propose a model-agnostic approach that transforms unstructured LLM outputs into precise structured formats. |
| Outcome: | The proposed model-agnostic approach transforms unstructured LLM outputs into precise structured formats. |
The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classification (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches for relation classification are focused on the English language and require lots of training data with human annotations. |
| Approach: | They propose a baseline model based on Multilingual BERT and a new multilingual pretraining setup . they propose 'relationship classification' models that use distant supervision . |
| Outcome: | The proposed model significantly improves the baseline model with distant supervision. |
CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph (2024.acl-demos)
Copied to clipboard
| Challenge: | Large language models (LLMs) are susceptible to generating hallucinated content and often encompass factually inaccurate information. |
| Approach: | They propose a framework that leverages knowledge graphs to address the limitations of Large Language Models (LLMs) they identify and decompose required knowledge triples that are not present in the KG, enriching them and aligning updates with real-world demands. |
| Outcome: | The proposed framework reduces hallucinations and increases factual accuracy in QA scenarios while retaining the same quality of knowledge. |
SeqAttack: On Adversarial Attacks for Named Entity Recognition (2021.emnlp-demo)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a task of recognizing named entities in a chunk of text. |
| Approach: | They investigate the portability of adversarial attacks from text classification to named entity recognition and the ability of adversary training to counteract these attacks. |
| Outcome: | The proposed framework and web application can be used to cherry pick adversarial examples and perform character-level and word-level attacks. |
ROPE: Reading Order Equivariant Positional Encoding for Graph-based Document Information Extraction (2021.acl-short)
Copied to clipboard
Chen-Yu Lee, Chun-Liang Li, Chu Wang, Renshen Wang, Yasuhisa Fujii, Siyang Qin, Ashok Popat, Tomas Pfister
| Challenge: | Graph Convolutional Networks (GCNs) have limited ability to capture reading orders of given word-level node representations in a graph. |
| Approach: | They propose a new positional encoding technique to capture word-level nodes in a graph. |
| Outcome: | The proposed method improves existing GCNs with an 8.4% F1 score on two datasets and a large-scale payment dataset. |
Sample Design Engineering: An Empirical Study on Designing Better Fine-Tuning Samples for Information Extraction with LLMs (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Prompt Engineering (PE) is renowned for improving IE performance through prompt modifications, but the realm of sample design for downstream fine-tuning remains unexplored. |
| Approach: | They propose a methodical approach to enhancing LLMs’ post-tuning performance by refining input, output, and reasoning designs. |
| Outcome: | The proposed approach outperforms heuristic design strategies on three complex IE tasks with four additional LLMs. |
Bootstrapping Transliteration with Constrained Discovery for Low-Resource Languages (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to transliteration generation require a large number of training examples. |
| Approach: | They propose a bootstrapping algorithm that uses constrained discovery to improve generation . they show that the model can be used with as few as 500 training examples . |
| Outcome: | The proposed method improves on nine languages written in a unique script. |
Natural Language Processing for Human Resources: A Survey (2025.naacl-industry)
Copied to clipboard
| Challenge: | Recent advances in NLP have the potential to transform HR processes, from recruitment to employee management. |
| Approach: | They analyze key tasks such as information extraction and text classification and their roles in downstream applications like recommendation and language generation while discussing ethical concerns. |
| Outcome: | The proposed frameworks can be applied to HR tasks and to recommendation, language generation, and interaction. |
Alignment Annotation for Clinic Visit Dialogue to Clinical Note Sentence Language Generation (2020.lrec-1)
Copied to clipboard
| Challenge: | Despite advances in natural language processing, converting a clinic visit conversation into a clinical note is a largely unexplored area of research. |
| Approach: | They propose an annotation methodology that is content- and technique- agnostic while associating note sentences to sets of dialogue sentences. |
| Outcome: | The proposed method is content- and technique-agnostic while associating note sentences to sets of dialogue sentences. |
Efficient Information Extraction in Few-Shot Relation Classification through Contrastive Representation Learning (2024.naacl-short)
Copied to clipboard
| Challenge: | Relation classification (RC) models extract rich information from sentences with limited labeled instances. |
| Approach: | They propose to combine multiple sentence representations with contrastive learning to enhance information extraction by combining multiple sentence and entity tokens. |
| Outcome: | The proposed approach is able to extract discriminative information from multiple representations and contrastive learning. |
Generative Models for Product Attribute Extraction (2023.emnlp-industry)
Copied to clipboard
| Challenge: | generative models are used for product attribute extraction, a new field in information extraction and e-commerce. |
| Approach: | They analyze generative models for product attribute extraction and demonstrate their utility . they perform experiments on Amazon and MAVE product attribute datasets . |
| Outcome: | The proposed model can generate implicit attribute values, which state-of-the-art models are unable to extract. |
Keep Your Bearings: Lightly-Supervised Information Extraction with Ladder Networks That Avoids Semantic Drift (N18-2)
Copied to clipboard
| Challenge: | Using ladder networks, semi-supervised learning can be iterative and drifts semantically as learning progresses. |
| Approach: | They propose a method that uses ladder networks to perform a task of named entity classification using a large, unannotated dataset. |
| Outcome: | The proposed method improves on two standard datasets for named entity classification. |
TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metrics (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent efforts to extract tasks, datasets and evaluation metrics from scientific literature focus on abstracts only. |
| Approach: | They propose a corpus that contains domain expert annotations for Task (T), Dataset (D), Metric (M) entities extracted from NLP papers. |
| Outcome: | The proposed corpus contains domain expert annotations for Task (T), Dataset (D), Metric (M) entities extracted from NLP papers. |
Syntactic Patterns Improve Information Extraction for Medical Search (N18-2)
Copied to clipboard
| Challenge: | Medical professionals search the literature by specifying the type of patients, the medical intervention(s) and the outcome measure(s). |
| Approach: | They propose to exploit the availability of structured abstracts to extract medically relevant information from syntactic patterns. |
| Outcome: | The proposed models differ from the constituent unigrams in the extracted patterns, suggesting that they capture contextual information that is otherwise lost. |
A Corpus to Learn Refer-to-as Relations for Nominals (L18-1)
Copied to clipboard
| Challenge: | Existing work on how to learn refer-to-as relations from large unlabeled corpora lacks coreferential information. |
| Approach: | They propose to use Wikipedia to generate coreferential neural embeddings for nominals . they use coreference resolution as a proxy to evaluate the neural embeds for noun phrases . |
| Outcome: | The proposed dataset can be leveraged to construct representations for coreferential nominals from Wikipedia. |
Introduction to Mathematical Language Processing: Informal Proofs, Word Problems, and Supporting Tasks (2023.tacl-1)
Copied to clipboard
| Challenge: | Using mathematical language processing methods, we analyze prevailing methods, existing limitations, and promising avenues for future research. |
| Approach: | They analyze mathematical language processing methods from recent years and highlight prevailing methodologies, existing limitations and promising avenues for future research. |
| Outcome: | The proposed methods highlight prevailing methods, existing limitations and promising avenues for future research. |
Cuckoo: An IE Free Rider Hatched by Massive Nutrition in LLM’s Nest (2025.acl-long)
Copied to clipboard
| Challenge: | Massive high-quality data, both pre-training raw texts and post-training annotations, have been carefully prepared to incubate advanced large language models (LLMs). |
| Approach: | They propose to reframe next-token prediction into extraction for tokens already present in the context of LLMs by reframing next-tongue prediction into IE models. |
| Outcome: | The proposed model learns 102.6M extractive data converted from pre-training and post-training data with better performance than existing pre-trained IE models. |
InTriage: Intelligent Telephone Triage in Pre-Hospital Emergency Care (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Existing TT processes face challenges such as incomplete data collection, communication barriers, and manual errors, leading to high over-triage and under-triages rates. |
| Approach: | They propose to use an AI-driven multilingual TT system to provide decision support for triage. |
| Outcome: | The proposed system achieves word error rate of 14.57% for speech recognition and an F1 score of 73.34% for key information extraction. |
FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discovery (2023.findings-acl)
Copied to clipboard
Changlong Yu, Weiqi Wang, Xin Liu, Jiaxin Bai, Yangqiu Song, Zheng Li, Yifan Gao, Tianyu Cao, Bing Yin
| Challenge: | Existing intention-based studies on recommendation tasks are limited and use models to implicitly model the intention memberships. |
| Approach: | They propose a framework that leverages the generation power of large language models and human-in-the-loop annotation to semi-automatically construct the intention knowledge graph. |
| Outcome: | The proposed framework can model e-commerce knowledge and have many potential applications. |
MEBench: Benchmarking Large Language Models for Cross-Document Multi-Entity Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) and Retrieval-augmented Generation (RAG) systems show promise, but their performance on cross-document MEQA remains underexplored due to the lack of tailored benchmarks. |
| Approach: | They propose a scalable multi-document, multi-entity benchmark to evaluate LLMs' capacity to retrieve, consolidate, and reason over scattered and dense information. |
| Outcome: | The proposed benchmarks show that even advanced models achieve only 59% accuracy on MEBench. |
The UIR Uncertainty Corpus for Chinese: Annotating Chinese Microblog Corpus for Uncertainty Identification from Social Media (L18-1)
Copied to clipboard
| Challenge: | Uncertainty identification is an important semantic processing task, critical to the quality of information in terms of factuality in many NLP techniques and applications. |
| Approach: | They propose to annotate Chinese microblogs with an open uncertainty corpus . they propose to use contextual uncertain semantics rather than traditional cue-phrases to identify uncertainty . |
| Outcome: | The proposed corpus can be used to identify uncertainty in social media texts. |
EventWiki: A Knowledge Base of Major Events (L18-1)
Copied to clipboard
| Challenge: | Existing knowledge bases focus on static entities such as people, locations and organizations. |
| Approach: | They propose a new knowledge base resource called EventWiki which concentrates on major events . they show that EventWiki is a very useful resource for information extraction regarding events in NLP . |
| Outcome: | The proposed resource is the first knowledge base resource of major events. |
Recipe Instruction Semantics Corpus (RISeC): Resolving Semantic Structure and Zero Anaphora in Recipes (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing approaches to understanding recipe instructions make assumptions that are domain specific. |
| Approach: | They propose a new dataset for information extraction on recipes . they avoid a priori pre-defining domain-specific predicates to recognize . instead, they focus on basic understanding of the expressed semantics . |
| Outcome: | The proposed dataset avoids a priori pre-defining domain-specific predicates to recognize . instead, it focuses on basic understanding of the expressed semantics rather than reducing them to a simplified state representation. |
A High Precision Pipeline for Financial Knowledge Graph Construction (2020.coling-main)
Copied to clipboard
Sarah Elhammadi, Laks V.S. Lakshmanan, Raymond Ng, Michael Simpson, Baoxing Huai, Zhefeng Wang, Lanjun Wang
| Challenge: | Knowledge graphs are a standard for structured knowledge representation in the Semantic Web. |
| Approach: | They propose to extract financial news articles into a knowledge graph by using a financial dictionary. |
| Outcome: | The proposed pipeline extracts 342,000 financial news articles with a precision of 78% at the top-100 extractions. |
A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extraction (2026.findings-acl)
Copied to clipboard
Chengguang Gan, Sunbowen Lee, Qingyu Yin, Yunhao Liang, Xinyang He, Hanjun Wei, Younghun Lim, Shijian Wang, Hexiang Huang, QingHao Zhang, Shiwen Ni, Tatsunori Mori
| Challenge: | Existing work on the Mutual Reinforcement Effect in information extraction has not been empirically validated . 76 percent of the 21 sub-datasets exhibit the Mutual Reforcement effect across languages . |
| Approach: | They propose a multilingual MRE mix dataset that integrates 21 sub-datasets covering English, Japanese, and Chinese. |
| Outcome: | The proposed framework reduces manual annotation effort while preserving structural requirements of MRE tasks. |
Extend, don’t rebuild: Phrasing conditional graph modification as autoregressive sequence labelling (2021.emnlp-main)
Copied to clipboard
| Challenge: | Generating or modifying graphs from natural language text has applications in many subfields, such as dependency parsing or knowledge graph construction. |
| Approach: | They propose a method that first embeds the graph and the instructions with a joint encoder and then rebuilds it using a separate generative model for graphs conditioned on h. |
| Outcome: | The proposed method improves accuracy on three scene graph modification data sets while the state-of-the-art fails to generalize. |
Adaptive Scaling for Sparse Detection in Information Extraction (P18-1)
Copied to clipboard
| Challenge: | Detection problems involving positive instances are often deficient in information extraction tasks . a number of researches have employed neural network models to solve detection problems . |
| Approach: | They propose an algorithm which can handle positive sparsity problem and directly optimize over F-measure . they borrow the idea of marginal utility from economics and propose a theoretical framework for instance importance measuring . |
| Outcome: | The proposed algorithm improves on positive sparsity problem and over F-measure . it leads to more effective and stable training of neural network based detection models. |
Supervised and Unsupervised Methods for Robust Separation of Section Titles and Prose Text in Web Documents (D18-1)
Copied to clipboard
| Challenge: | a web text structure is underutilized, but its visual organization is useful for NLP tasks . a flexible system for extracting hierarchical section titles and prose organization is developed . |
| Approach: | a new system extracts hierarchical section titles and prose organization from web documents . the system uses features from syntax, semantics, discourse and markup to build two models . |
| Outcome: | a new system extracts the hierarchical section titles and prose organization of web documents . the system achieves an overall precision of 0.82 and a recall of 0.98 on three domains of web text . |
A Bayesian Approach for Sequence Tagging with Crowds (D19-1)
Copied to clipboard
| Challenge: | Existing methods for sequence tagging are data hungry and annotators are unreliable . current methods do not account for common types of span annotation error . |
| Approach: | They propose a Bayesian method for aggregating sequence tags that models sequential dependencies between annotations and ground-truth labels. |
| Outcome: | The proposed method outperforms existing methods on crowdsourced data and reduces crowdsourcing costs through active learning. |
Extraction of Information Provision Activity Requirements from EU Acquis (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Using knowledge-, classical ML-, transformer-, and generative AI-based approaches, we extract structured information from EU acquis documents. |
| Approach: | They propose a task of Information Provision Activity Requirement Extraction to identify text fragments that introduce an obligation to provide information and the extraction of structured information about the key entities involved. |
| Outcome: | The proposed task is based on knowledge-, classical ML-, transformer-, and generative AI-based approaches. |
BlogSet-BR: A Brazilian Portuguese Blog Corpus (L18-1)
Copied to clipboard
| Challenge: | Several efforts have been made to build a corpus based on user-generated content . however, there is still a lack of a large semi-structured corpus that also contains author profiles in Brazilian Portuguese. |
| Approach: | They propose to build a Brazilian Portuguese corpus with 2.1 billion words extracted from 7.4 million posts over 808 thousand different Brazilian blogs. |
| Outcome: | The proposed corpus contains 2.1 billion words extracted from 7.4 million posts over 808 thousand different Brazilian blogs. |
IPED: An Implicit Perspective for Relational Triple Extraction based on Diffusion Model (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to extract relational triples have inherent shortcomings such as redundant information and incomplete triple recognition. |
| Approach: | They propose an Implicit Perspective for relational triple Extraction based on Diffusion model that uses block coverage to complete tables. |
| Outcome: | The proposed method achieves state-of-the-art performance while gaining low computational complexity. |
Good Visual Guidance Make A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extraction (2022.findings-naacl)
Copied to clipboard
Xiang Chen, Ningyu Zhang, Lei Li, Yunzhi Yao, Shumin Deng, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen
| Challenge: | Existing approaches for named entity recognition and relation extraction suffer from error sensitivity when irrelevant object images are incorporated in texts. |
| Approach: | They propose a hierarchical visual prefix fusion NeTwork for visual-enhanced entity and relation extraction using pluggable visual prefixed visual features. |
| Outcome: | The proposed method achieves state-of-the-art on three benchmark datasets. |
MPL: Multiple Programming Languages with Large Language Models for Information Extraction (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing research focuses on Python for code-style simulation, overlooking the potential of other widely-used PLs during the supervised fine-tuning phase. |
| Approach: | They propose a framework that incorporates programming languages into IE tasks . they introduce function-prompt with virtual running to simulate code-style inputs . |
| Outcome: | The proposed framework exploits the potential of different programming languages during the supervised fine-tuning phase. |
Enhancing Discriminative Representation in Similar Relation Clusters for Few-Shot Continual Relation Extraction (2025.naacl-long)
Copied to clipboard
Anh Duc Le, Nam Le Hai, Thanh Xuan Nguyen, Linh Ngo Van, Nguyen Thi Ngoc Diep, Sang Dinh, Thien Huu Nguyen
| Challenge: | Existing methods for relation extraction (RE) fail to address the problem of similar relations, which contributes to catastrophic forgetting. |
| Approach: | They propose a relation extraction method that utilizes relation descriptions and dynamic clustering to identify similar relations. |
| Outcome: | The proposed method mitigates catastrophic forgetting and outperforms state-of-the-art methods by a large margin. |
M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis (2025.emnlp-main)
Copied to clipboard
ChengYan Wu, Bolei Ma, Yihong Liu, Zheyu Zhang, Ningyuan Deng, Yanshu Li, Baolan Chen, Yi Zhang, Yun Xue, Barbara Plank
| Challenge: | Existing studies focus on English-centric aspects of sentiment analysis, limiting scope for multilingual evaluation and research. |
| Approach: | They propose to use a multilingual dataset to analyze aspects with associated sentiment elements in text. |
| Outcome: | The proposed dataset is the most extensive multilingual parallel dataset for ABSA to date. |
Joint Entity and Relation Extraction for Legal Documents with Legal Feature Enhancement (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for information extraction are based on pipelining to extract entities from unstructured judgment documents . a large number of judgment documents are released on China Judgments Online . |
| Approach: | They propose a legal triplet extraction system for drug-related criminal judgment documents . they annotate a dataset for Named Entity Recognition and Relation Extraction in Chinese legal domain . |
| Outcome: | The proposed system extracts entities and semantic relations jointly and benefits from the proposed legal lexicon feature and multi-task learning framework. |
Event Detection as Graph Parsing (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to event detection focus on using syntactic dependency structures or external knowledge to boost the performance. |
| Approach: | They propose a graph parsing problem that explicitly models multiple event correlations and utilizes rich information conveyed by event type and subtype. |
| Outcome: | The proposed model outperforms existing models on the public ACE2005 dataset by 4.2% on the dataset. |
Measurement Extraction with Natural Language Processing: A Review (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Information extraction (IE) is a task in natural language processing that extracts information from documents. |
| Approach: | They describe different approaches to measurement extraction and outline challenges posed by this task. |
| Outcome: | The proposed methods are compared with the literature on the extraction of quantitative data from documents. |
Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to cross-document event coreference resolution are prone to learning simple co-occurrences due to the complexity of contexts. |
| Approach: | They propose a collaborative approach to cross-document event coreference resolution that leverages both a universally capable LLM and a task-specific SLM. |
| Outcome: | The proposed approach surpasses the performance of both large and small language models individually, underscoring its effectiveness in diverse scenarios. |
OneEE: A One-Stage Framework for Fast Overlapping and Nested Event Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Event extraction (EE) is an essential task of information extraction, which aims to extract structured event information from unstructured text. |
| Approach: | They propose a tagging scheme and a model to form EE as word-word relation recognition using parallel grid tapping. |
| Outcome: | The proposed model achieves state-of-the-art on 3 overlapped and nested EE benchmarks and faster than baselines. |
Event Detection with Dual Relational Graph Attention Networks (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to event detection confuse syntactic relations and introduce redundant or noisy information, leading to performance degradation. |
| Approach: | They propose a model that exploits syntactic and semantic relations to alleviate the problem by combining syntatic and semantic knowledge. |
| Outcome: | The proposed model outperforms state-of-the-art methods on a ACE2005 benchmark dataset. |
Text-to-Table: A New Way of Information Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for information extraction are not well understood . text-to-table is a problem that aims to extract information from text data . |
| Approach: | They propose a new problem setting of information extraction, called text-to-table . they formalize text- to-table as a sequence-tosequence problem . |
| Outcome: | The proposed method outperforms existing methods on text-to-table tasks. |
Uncertainty Estimation on Sequential Labeling via Uncertainty Transmission (2024.findings-naacl)
Copied to clipboard
| Challenge: | Named entity recognition tasks are often suboptimal for NER . previous work focused on UE-NER, which estimates uncertainty scores for ner . |
| Approach: | They propose to use a Sequential Labeling Posterior Network to estimate uncertainty for NER . they propose to consider wrong-span cases and to evaluate the specificity of wrong-pan cases. |
| Outcome: | The proposed system improves on three datasets and AUPR on MIT-Restaurant datasets. |
Massively Multilingual Instruction-Following Information Extraction (2025.findings-acl)
Copied to clipboard
| Challenge: | Past literature on information extraction (IE) has focused on a few high-resource languages, hindering their applications on multilingual corpora. |
| Approach: | They propose a collection of data that unifies and standardizes instruction-following multilingual IE and introduce a structure-aware metric that captures partially matched spans. |
| Outcome: | The proposed framework standardizes and unifies 215 manually annotated datasets, covering 96 typologically diverse languages from 18 language families. |
Automated Refugee Case Analysis: A NLP Pipeline for Supporting Legal Practitioners (2023.findings-acl)
Copied to clipboard
| Challenge: | In Canada, retrieving similar cases and their analysis is a key part of legal work . long processing times are due to a significant backlog and to the amount of work required from counsels . |
| Approach: | They propose to extend existing neural named-entity recognition models to retrieve 19 categories of items from refugee cases. |
| Outcome: | The proposed pipeline achieves a superior F1- score on five of the targeted categories and superior to 80% on an additional 4 categories. |
Chain-of-Interactions: Multi-step Iterative ICL Framework for Abstractive Task-Oriented Dialogue Summarization of Conversational AI Interactions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have introduced paradigm-shifting approaches in natural language processing, yet their transformative in-context learning (ICL) capabilities remain underutilized, especially in customer service dialogue summarization. |
| Approach: | They propose a single-instance, multi-step framework that orchestrates information extraction, self-correction, and evaluation through sequential interactive generation chains. |
| Outcome: | The proposed framework outperforms existing models and prompts in the customer service dialogue summarization domain. |
MUSIED: A Benchmark for Event Detection from Multi-Source Heterogeneous Informal Texts (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent efforts to classify unstructured texts into specific types have been limited in practical scenarios. |
| Approach: | They propose to use Chinese text conversations and phone conversations to expand event detection to the scenarios involving informal and heterogeneous texts. |
| Outcome: | The proposed dataset is based on user reviews, text conversations, and phone conversations in a leading e-commerce platform for food service. |
SmartBench: Is Your LLM Truly a Good Chinese Smartphone Assistant? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks for Large Language Models focus on objective tasks like mathematics and coding in English, which do not reflect the practical use cases of on-device LLMs in real-world mobile scenarios. |
| Approach: | They propose a benchmark to evaluate the capabilities of on-device Large Language Models in Chinese mobile contexts. |
| Outcome: | The proposed framework evaluates on-device LLMs and MLLMs in Chinese . it provides a standardized framework for evaluating LLM performance on real smartphones . |
Retrieval Augmented Instruction Tuning for Open NER with Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies have focused on integrating large language models (LLMs) with information extraction (IE) however, the best approach to incorporate information with LLMs for IE remains an open question. |
| Approach: | They propose to use a Chinese IT dataset to perform RA-IT for IE . they use semantically similar examples from the training dataset as the context . |
| Outcome: | The proposed approach is evaluated in English and Chinese scenarios. |
Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context Experts (2022.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning has emerged as a promising approach to resolve anaphora, but there are challenges in applying it to scientific protocols. |
| Approach: | They propose a method which combines predictions of hundreds of in-context experts and combines them to yield a 30% increase in F1 over a competitive prompt retrieval baseline. |
| Outcome: | The proposed method yields 30% increase in F1 score over a competitive prompt retrieval baseline. |
MultiTACRED: A Multilingual Version of the TAC Relation Extraction Dataset (2023.acl-long)
Copied to clipboard
| Challenge: | Relation extraction (RE) is a fundamental task in information extraction, but its extension to multilingual settings is hindered by the lack of supervised resources comparable in size to large English datasets. |
| Approach: | They propose a dataset to analyze relation extraction (RE) in multilingual settings . they find machine translation is a viable strategy to transfer RE instances . |
| Outcome: | The proposed dataset covers 12 typologically diverse languages from 9 language families and is compared with existing datasets. |
Edge-Enhanced Graph Convolution Networks for Event Detection with Syntactic Relation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Event detection (ED) is a key subtask of information extraction. |
| Approach: | They propose an architecture that exploits syntactic structure and typed dependency label information to perform event detection. |
| Outcome: | The proposed architecture exploits syntactic structure and typed dependency label information to perform ED. |
AD3: Attentive Deep Document Dater (D18-1)
Copied to clipboard
| Challenge: | Existing methods to predict creation time of documents are based on time-stamp metadata, but none are available. |
| Approach: | They propose an attention-based neural document dating system which utilizes both context and temporal information in documents in a flexible and principled manner. |
| Outcome: | The proposed system outperforms neural and non-neural baselines on multiple real-world datasets. |
BKEE: Pioneering Event Extraction in the Vietnamese Language (2024.lrec-main)
Copied to clipboard
| Challenge: | Event Extraction (EE) is a fundamental task in information extraction. |
| Approach: | They propose a Vietnamese event extraction dataset that includes 33 different event types and 28 different event argument roles. |
| Outcome: | The proposed dataset provides a labeled dataset for entity mentions, event mentions and event arguments on 1066 documents. |
Entity Relation Extraction as Dependency Parsing in Visually Rich Documents (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on key information extraction from visually rich documents focus on labeling the text within bounding boxes, while relations between words are unexplored. |
| Approach: | They propose to use a dependency parsing model to extract semantic entities from visually rich documents by combining entity labeling and relation extraction tasks. |
| Outcome: | The proposed model achieves 65.96% F1 score on the FUNSD dataset. |
Relation Extraction with Type-aware Map Memories of Word Dependencies (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on the dependency connections between words with limited attention paid to exploiting dependency types. |
| Approach: | They propose a neural approach for relation extraction with type-aware map memories . they map all associated words along with dependencies among them to memory slots . |
| Outcome: | The proposed approach achieves state-of-the-art on two English benchmark datasets. |
Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies highlight the struggles even large language models encounter when it comes to performing spatial reasoning over text. |
| Approach: | They propose to disentangle spatial reasoning over text and compare them to state-of-the-art models with no explicit design for these parts. |
| Outcome: | The proposed models show that they can perform spatial reasoning over text and can generalize within real data domains. |
Omni-Chart-600K: A Comprehensive Dataset of Chart Types for Chart Understanding (2025.findings-naacl)
Copied to clipboard
Shulei Wang, Shuai Yang, Wang Lin, Zirun Guo, Sihang Cai, Hai Huang, Ye Wang, Jingyuan Chen, Tao Jin
| Challenge: | Existing chart-related training methods lack capabilities in information extraction, mathematical reasoning, and understanding of multiple chart types. |
| Approach: | They propose a two-stage training strategy and method for jointly training a vision encoder tailored for multi-type charts to address the deficiencies in chart types and limited scope of chart tasks in existing datasets. |
| Outcome: | The proposed dataset includes 21 diverse chart types and tasks, including data retrieval and mathematical reasoning. |
ReCoT-NER: Enhancing Zero-Shot Named Entity Recognition through Chain-of-Thought Prompting and Recall-Oriented Loss Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a key component of natural language processing (NLP) but it is difficult to implement in specialized domains such as wind power fault diagnosis. |
| Approach: | They propose a reasoning-enhanced generative framework that integrates Chain-of-Thought prompting and recall-oriented loss optimization to address these challenges. |
| Outcome: | The proposed framework improves recall and overall F1 performance across general and industrial domains. |
Boundary-Aware LLM Augmentation for Low-Resource Event Argument Extraction (2026.eacl-long)
Copied to clipboard
| Challenge: | Event argument extraction (EAE) is a crucial task in information extraction but its performance heavily depends on expensive annotated data. |
| Approach: | They investigate argument replacement, adjunction rewriting, their combination, and annotation generation using four LLM-based augmentation strategies. |
| Outcome: | The proposed methods improve performance over boundary-agnostic methods and provide detailed analysis of quality from multiple perspectives. |
WEXEA: Wikipedia EXhaustive Entity Annotation (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for extracting factual knowledge from text are limited to a few subtasks. |
| Approach: | They propose to use Wikipedia to build a corpus with exhaustive annotations of entity mentions. |
| Outcome: | The proposed system can be used to build supervised datasets and can be reproduced by everyone. |
Handling Entity Normalization with no Annotated Corpus: Weakly Supervised Methods Based on Distributional Representation and Ontological Information (2020.lrec-1)
Copied to clipboard
Arnaud Ferré, Robert Bossy, Mouhamadou Ba, Louise Deléger, Thomas Lavergne, Pierre Zweigenbaum, Claire Nédellec
| Challenge: | Entity normalization is an important subtask of information extraction . it links entities mentions in text to categories or concepts in a reference vocabulary . |
| Approach: | They propose a method that uses corpus selection, pre-processing and weak supervision strategies to address the scarcity of training data. |
| Outcome: | The proposed method outperforms state-of-the-art methods in terms of accuracy and parametrization . it uses corpus selection, pre-processing and weak supervision strategies . |
CARE: Co-Attention Network for Joint Entity and Relation Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing joint entity and relation extraction methods suffer from feature confusion or inadequate interaction between the two subtasks. |
| Approach: | They propose a Co-Attention network for joint entity and relation extraction that adopts a parallel encoding strategy to learn separate representations for each subtask. |
| Outcome: | The proposed model outperforms existing models on three datasets . it uses a parallel encoding strategy to learn separate representations for each subtask . |
Event Extraction from Unstructured Amharic Text (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing information extraction systems for Amharic have not represented the linguistic structure and morphological richness of the languages. |
| Approach: | They propose a system that extracts an event from unstructured Amharic text using supervised machine learning and rule-based approaches. |
| Outcome: | The proposed system outperforms the existing rule-based method on Amharic text. |
MyFixit: An Annotated Dataset, Annotation Tool, and Baseline Methods for Information Extraction from Repair Manuals (2020.lrec-1)
Copied to clipboard
| Challenge: | Textual instructions are among the most widely used media for learning and teaching . however, to create autonomous systems, it is difficult to extract task knowledge from text . |
| Approach: | They propose methods that can extract information from repair manuals from a semi-structured dataset . they propose a bag-of-n-grams similarity method and deep-learning-based sequence labeling model . |
| Outcome: | The proposed methods can extract the needed tools and disassembled parts from repair manuals. |
Visually Guided Generative Text-Layout Pre-training for Document Intelligence (2024.naacl-long)
Copied to clipboard
| Challenge: | Prior work shows that pre-training techniques can boost the performance of visual document understanding (VDU) . Xu et al., 2020;; Gu e t al, 2021;; Appalaraju e al. 2022) |
| Approach: | They propose a visually guided generative text-layout pre-training method that optimizes hierarchical language and layout modeling objectives to generate interleaved text and layout sequences. |
| Outcome: | The proposed model can process word-intensive documents of any length and achieves competitive performance over baselines on VDU tasks. |
Learning to Update Knowledge Graphs by Reading News (D19-1)
Copied to clipboard
| Challenge: | Existing methods to update knowledge graphs rely on elaborately designed IE systems and domain-specific rules. |
| Approach: | They propose a novel neural network method to update knowledge graphs (KGs) they use a text-based attention mechanism to guide updating messages through KGs . |
| Outcome: | The proposed method can effectively broadcast news information to KG structures and perform necessary link-adding or link-deleting operations to ensure the KG up-to-date according to news snippets. |
MRL Parsing Without Tears: The Case of Hebrew (2024.findings-acl)
Copied to clipboard
| Challenge: | a new approach to parsing morphologically rich languages (MRLs) is needed to overcome the deficiencies of current approaches. |
| Approach: | They propose a "flipped pipeline" where multiple layers are predicted independently on whole-token basis and then synthesized. |
| Outcome: | The proposed model achieves near-SOTA performance on Hebrew NLP tasks. |
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding (2022.findings-emnlp)
Copied to clipboard
Qiming Peng, Yinxu Pan, Wenjin Wang, Bin Luo, Zhenyu Zhang, Zhengjie Huang, Yuhui Cao, Weichong Yin, Yongfeng Chen, Yin Zhang, Shikun Feng, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
| Challenge: | Existing methods for visually rich document understanding lack layout-centered knowledge . experimental results show that ERNIE-Layout improves layout awareness . |
| Approach: | They propose a document pre-training solution with layout knowledge enhancement in the whole workflow to learn better representations that combine the features from text, layout, and image. |
| Outcome: | The proposed model outperforms existing models on key downstream tasks. |
Building an Ellipsis-aware Chinese Dependency Treebank for Web Text (L18-1)
Copied to clipboard
| Challenge: | ellipsis is a common linguistic phenomenon that some words are left out as they are understood from the context, especially in oral utterance. |
| Approach: | They propose to use a Chinese dependency treebank to facilitate the parsing of web text . they propose to restore omissions and reserve contexts in the web text to improve dependency parsers . |
| Outcome: | The proposed framework enables the parsing of web text from online microblogs. |
Quantifying Similarity between Relations with Fact Distribution (P19-1)
Copied to clipboard
| Challenge: | a conceptually simple and effective method to quantify the similarity between relations is presented . identifying relations is a crucial problem for several information extraction tasks. |
| Approach: | They propose a method to quantify the similarity between relations in knowledge bases . they use a neural network to parameterize conditional probability distributions over entity pairs . |
| Outcome: | The proposed method significantly correlates with human judgments, the authors show . it could be incorporated into negative sampling and softmax classification to alleviate these mistakes. |
Matching the Blanks: Distributional Similarity for Relation Learning (P19-1)
Copied to clipboard
| Challenge: | Efforts to build general purpose relation extractors that can model arbitrary relations are limited in their ability to generalize. |
| Approach: | They propose to build task-agnostic relation representations solely from entity-linked text to extend Harris’ distributional hypothesis to relations. |
| Outcome: | The proposed representations outperform previous methods on SemEval 2010 Task 8, KBP37, and TACRED even without using any of the task’s training data. |
ChatUIE: Exploring Chat-based Unified Information Extraction Using Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have shown impressive performance in general chat, but their domain-specific capabilities have certain limitations. |
| Approach: | They propose a unified information extraction framework built upon ChatGLM that incorporates domain-specific modeling to extract structured information from natural language. |
| Outcome: | The proposed framework significantly improves the performance of information extraction tasks with a slight decrease in chatting ability. |
Multiple Knowledge GraphDB (MKGDB) (2020.lrec-1)
Copied to clipboard
| Challenge: | ConceptNet, DBpedia, WebIsAGraph, WordNet and Wikipedia category hierarchy are used to create a large-scale graph database. |
| Approach: | They propose to use multiple taxonomy backbones extracted from 5 existing knowledge graphs to create a large-scale graph database. |
| Outcome: | The proposed database is intended to favour and support the development of open-domain natural language processing applications relying on knowledge bases. |
Class-Incremental Few-Shot Event Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to deal with new class of events with only a few labeled instances are challenging . old knowledge forgetting and new class overfitting are two problems in this task. |
| Approach: | They propose a task called class-incremental few-shot event detection to solve old knowledge forgetting and new class overfitting problems. |
| Outcome: | The proposed method reduces old knowledge forgetting and new class overfitting problems on two benchmark datasets. |
A High-Quality Gold Standard for Citation-based Tasks (L18-1)
Copied to clipboard
| Challenge: | Citation recommendation tasks involve recommending citations within their specific contexts. |
| Approach: | They propose to use arXiv.org's citation-dependent evaluation data set to evaluate citations . their data set is characterized by the fact that it exhibits almost zero noise in its extracted content . |
| Outcome: | The proposed data set exhibits almost zero noise in extracted content and all citations are linked to their correct publications. |
A general framework for information extraction using dynamic span graphs (N19-1)
Copied to clipboard
| Challenge: | Existing frameworks for information extraction use a pipeline approach to identify entities and then use the detected entity spans for relation extraction and coreference resolution. |
| Approach: | They propose a framework for several information extraction tasks that share span representations using dynamically constructed span graphs. |
| Outcome: | The proposed framework significantly outperforms state-of-the-art on multiple information extraction tasks across multiple datasets reflecting different domains. |
CollabKG: A Learnable Human-Machine-Cooperative Information Extraction Toolkit for (Event) Knowledge Graph Construction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing IE tools lack multi-task support and automatic updates for KG and EKG construction. |
| Approach: | They propose a human-machine-cooperative IE toolkit for KG and EKG construction that unifies different IE subtasks and integrates LLMs as the assistant machine. |
| Outcome: | The proposed tool improves annotation quality, efficiency, and stability simultaneously. |
SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature (2025.emnlp-main)
Copied to clipboard
David Wadden, Kejian Shi, Jacob Morrison, Alan Li, Aakanksha Naik, Shruti Singh, Nitzan Barzilay, Kyle Lo, Tom Hope, Luca Soldaini, Shannon Zejiang Shen, Doug Downey, Hannaneh Hajishirzi, Arman Cohan
| Challenge: | ScIRIFF is the only entirely expert-written instruction-following dataset for scientific literature understanding . it features complex instructions with long input contexts, detailed task descriptions, and structured outputs. |
| Approach: | They present a dataset of 137K instruction-following instances for training and evaluation . they finetuned large language models using a mix of general domain and ScIRIFF instructions . |
| Outcome: | The proposed dataset shows that on nine out-of-distribution held-out tasks, the model performs better than baselines trained on general domain instructions. |
AMR Beyond the Sentence: the Multi-sentence AMR corpus (C18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is limited to capturing the semantics of individual sentences. |
| Approach: | They propose a corpus that annotates coreference and similar phenomena on top of existing AMRs. |
| Outcome: | The proposed corpus is compared with existing corpora on sentence-level semantics . it shows that it can be used for information extraction and question answering . |
TagRAG: Tag-guided Hierarchical Knowledge Graph Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to retrieval-augmented generation rely on fragment-level retrieval . GraphRAG suffers from inefficiencies in information extraction and costly resource consumption . |
| Approach: | They propose a tag-guided hierarchical knowledge graph RAG framework for efficient global reasoning and scalable graph maintenance. |
| Outcome: | GraphRAG achieves an average win rate of 78.36% on a dataset spanning agriculture, computer science, law, and cross-domain settings compared with baselines . |
Joint Extraction of Entities, Relations, and Events via Modeling Inter-Instance and Inter-Label Dependencies (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing models that perform information extraction tasks manually assume heuristic dependency between the task instances and mean-field factorization for the joint distribution of instance labels. |
| Approach: | They propose to induce a dependency graph among task instances to boost representation learning by estimating their joint distribution via Conditional Random Fields. |
| Outcome: | The proposed model outperforms previous models on multiple IE tasks across 5 datasets and 2 languages. |
Transforming Complex Sentences into a Semantic Hierarchy (P19-1)
Copied to clipboard
| Challenge: | Existing approaches for recursively splitting and rephrasing complex English sentences into a semantic hierarchy of simplified sentences are lacking. |
| Approach: | They propose a method for recursively splitting and rephrasing complex English sentences into a semantic hierarchy of simplified sentences. |
| Outcome: | The proposed approach outperforms state-of-the-art approaches in MT and information extraction tasks. |
GenIE: Generative Information Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to open information extraction only work with unrealistically small numbers of entities and relations. |
| Approach: | They propose to use a transformer encoder-decoder model to extract triplets from unstructured text . they use 'generative information extraction' to generate triplet representations of information . |
| Outcome: | The proposed model is state-of-the-art on closed information extraction and generalizes from fewer training data points than baselines. |
Rumor Detection on Social Media with Crowd Intelligence and ChatGPT-Assisted Networks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on rumor detection challenges the expressive power of text encoding sequences, and insufficient mining of semantic structural information. |
| Approach: | They propose a Crowd Intelligence-based semantic feature learning module to capture textual content’s sequential and hierarchical features and a knowledge-based structural mining module that leverages ChatGPT for knowledge enhancement. |
| Outcome: | The proposed system achieves performance improvement in rumor detection tasks validating the effectiveness and rationality of using large language models as auxiliary tools. |
A Neural Network Architecture for Program Understanding Inspired by Human Behaviors (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies for understanding programs do not take human behaviors as reference. |
| Approach: | They propose a graph neural network model that takes human behaviors as reference in understanding programs. |
| Outcome: | The proposed model performs better on code summarization and code clone detection tasks. |
Frustratingly Easy Label Projection for Cross-lingual Transfer (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to improve cross-lingual transfer performance are based on word alignment, but no empirical studies have evaluated their effectiveness or limitations. |
| Approach: | They propose a mark-then-translate method that integrates translation and projection by inserting special markers around the labeled spans in the original sentence. |
| Outcome: | The proposed method outperforms word alignment-based methods in 57 languages and three tasks. |
Dynamic Global Memory for Document-level Argument Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work on document-level event argument extraction is restricted by sequence length constraints and ignores global context between events. |
| Approach: | They propose to construct a document memory store to extract contextual event information and leverage it to implicitly and explicitly help with decoding of arguments for later events. |
| Outcome: | The proposed framework outperforms prior methods and is more robust to adversarially annotated examples with constrained decoding design. |
ENGLAWI: From Human- to Machine-Readable Wiktionary (2020.lrec-1)
Copied to clipboard
| Challenge: | ENGLAWI is a structured and normalized version of the English Wiktionary encoded into a workable XML format. |
| Approach: | They introduce ENGLAWI, a large, versatile, XML-encoded machine-readable dictionary extracted from Wiktionary. |
| Outcome: | The proposed lexicographic word embeddings are based on the ENGLAWI definitions and are available for download and are supplied with G-PeTo scripts. |
Active Learning for Abstractive Text Summarization (2022.findings-emnlp)
Copied to clipboard
Akim Tsvigun, Ivan Lysenko, Danila Sedashov, Ivan Lazichny, Eldar Damirov, Vladimir Karlov, Artemy Belousov, Leonid Sanochkin, Maxim Panov, Alexander Panchenko, Mikhail Burtsev, Artem Shelmanov
| Challenge: | Abstractive text summarization (ATS) requires a long document and short summaries. |
| Approach: | They propose a query strategy for AL in abstractive text summarization that uses uncertainty estimation to reduce model performance. |
| Outcome: | The proposed query strategy improves ROUGE and consistency scores for annotated datasets . it also increases the performance of the model, compared to passive annotation. |
Negation Scope Refinement via Boundary Shift Loss (2023.findings-acl)
Copied to clipboard
| Challenge: | Negation detection is a complex linguistic phenomenon with long spans . existing methods tend to make wrong predictions around the scope boundaries . |
| Approach: | They propose a model which engages the Boundary Shift Loss to refine the predicted boundary. |
| Outcome: | The proposed model refines the predicted boundary on multiple datasets. |
Translation and Fusion Improves Cross-lingual Information Extraction (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown significant progress in information extraction tasks due to lack of labeled data for fine-tuning and unlabeled text for pre-training. |
| Approach: | They propose a framework in which large language models are fine-tuned to use English translations of low-resource language data. |
| Outcome: | The proposed model improves cross-lingual transfer over the base model on 12 multilingual IE datasets spanning 50 languages. |
The IARPA BETTER Program Abstract Task Four New Semantically Annotated Corpora from IARPA’s BETTER Program (2022.lrec-1)
Copied to clipboard
| Challenge: | IARPA’s Better Extraction from Text Towards Enhanced Retrieval (BETTER) Program created multiple multilingual datasets to spawn and evaluate cross-language information extraction and information retrieval research and development in zero-shot conditions. |
| Approach: | The paper presents the event and argument annotation in the Abstract Evaluation phase of BETTER . it also presents the data collection, preparation, partitioning and mark-up of the datasets . |
| Outcome: | The “Abstract” dataset will be released to the public at LREC 2022 in four languages to champion further information extraction research in this area. |
A Named Entity Recognition Corpus for Vietnamese Biomedical Texts to Support Tuberculosis Treatment (2022.lrec-1)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is an important task in information extraction. |
| Approach: | They construct a labelled NER corpus of Vietnamese academic biomedical text . they annotate documents with five categories of named entities: Organisation, Location, Date and Time, Symptom and Disease, and Diagnostic Procedure. |
| Outcome: | The proposed system could provide answers to questions related to TB in Vietnamese . the system could also be used to identify TB-related diseases in the country . |
ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferences (2024.acl-long)
Copied to clipboard
| Challenge: | Current large language models (LLMs) are ineffective in learning domain knowledge and aligning with human preference. |
| Approach: | They propose a benchmark LLM for Chinese medical domain that uses pre-training, supervised fine-tuning and RLHF to train LLMs. |
| Outcome: | The proposed LLM performs better than existing LLMs in the Chinese medical domain. |
Looking inside Noun Compounds: Unsupervised Prepositional and Free Paraphrasing (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Noun compound interpretation is the task of uncovering the semantic relation between the components of a noun compound. |
| Approach: | They propose an unsupervised method for identifying such relations between the components of a noun compound using pre-trained contextualized language models. |
| Outcome: | The proposed method outperforms supervised approaches for free paraphrasing and prepositional paraphrases using pre-trained language models to uncover ‘missing’ words. |
Learning to Extract Structured Entities Using Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Language Models (LMs) play a pivotal role in extracting structured information from unstructured text. |
| Approach: | They propose to reformulate the task to be entity-centric, enabling the use of diverse metrics that can provide more insights from various perspectives. |
| Outcome: | The proposed model outperforms baselines and human evaluations on the extracted entities. |
ADAPTIVE IE: Investigating the Complementarity of Human-AI Collaboration to Adaptively Extract Information on-the-fly (2025.coling-main)
Copied to clipboard
Ishani Mondal, Michelle Yuan, Anandhavelu N, Aparna Garimella, Francis Ferraro, Andrew Blair-Stanek, Benjamin Van Durme, Jordan Boyd-Graber
| Challenge: | Existing IE systems are either fully supervised, requiring expensive human annotations, or fully unsupervised, extracting information that often do not cater to user’s needs. |
| Approach: | They propose a framework that uses human-in-the-loop refinement to adapt to changing user questions. |
| Outcome: | The proposed framework is domain-agnostic, responsive, efficient for helping users access useful information while quickly reorganizing information in response to evolving information needs. |
Few-shot clinical entity recognition in English, French and Spanish: masked language models outperform generative model prompting (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a critical task in information extraction that is not covered in recent benchmarks. |
| Approach: | They compare 13 auto-regressive models using prompting and 16 masked models using fine-tuning on 14 NER datasets covering English, French and Spanish. |
| Outcome: | The proposed models outperform auto-regressive models in English, French and Spanish on 14 NER datasets. |
Deep Learning Based Named Entity Recognition Models for Recipes (2024.lrec-main)
Copied to clipboard
Ayush Agarwal, Janak Kapuriya, Shubham Agrawal, Akhil Vamshi Konam, Mansi Goel, Rishabh Gupta, Shrey Rastogi, Niharika Niharika, Ganesh Bagler
| Challenge: | Named entity recognition is a technique for extracting information from unstructured data with known labels. |
| Approach: | They use named entity recognition to annotate ingredients from recipe data . they use a clustering-based approach to annnotate 88,526 phrases . |
| Outcome: | The proposed method improves on a dataset of 88,526 phrases from RecipeDB . the fine-tuned spaCy-transformer performs better than the previous methods . |
Do You Know That Florence Is Packed with Visitors? Evaluating State-of-the-art Models of Speaker Commitment (P19-1)
Copied to clipboard
| Challenge: | Existing models for speaker commitment fail to generalize to diverse linguistic constructions, highlighting directions for improvement. |
| Approach: | They evaluate two state-of-the-art speaker commitment models on the CommitmentBank . they analyze linguistic correlates of model error on a naturalistic dataset . |
| Outcome: | The proposed models perform well on some classes but fail to generalize to diverse linguistic constructions. |
Lazy-k Decoding: Constrained Decoding for Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Specifically, we combine probabilistic models with constrained decoding approaches in structured prediction tasks. |
| Approach: | They propose a constrained decoding method called Lazy-k to combine probabilistic models with constrained methods in structured prediction. |
| Outcome: | The proposed method allows for more flexibility between decoding time and accuracy. |
ADELIE: Aligning Large Language Models on Information Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) struggle to follow complex instructions of IE tasks due to not being aligned with humans. |
| Approach: | They propose an aligned large language moDEL that effectively solves various IE tasks including closed IE, open IE and on-demand IE. |
| Outcome: | The proposed model achieves state-of-the-art (SoTA) performance among open-source models. |
Learning Prototype Representations Across Few-Shot Tasks for Event Detection (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing training data for event detection are too expensive to achieve in real applications where novel event types emerge . Typical ED systems require labeled data for each predefined event type, but only a few examples are available. |
| Approach: | They propose to introduce cross-task prototypes to model relationships between training tasks in few-shot learning for event detection. |
| Outcome: | The proposed model improves on three few-shot learning datasets. |
Modular Self-Supervision for Document-Level Relation Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Prior work on information extraction tends to focus on binary relations within sentences . practical applications often require extracting complex relations across large text spans . |
| Approach: | They propose to decompose document-level relation extraction into relation detection and argument resolution, taking inspiration from Davidsonian semantics. |
| Outcome: | The proposed method outperforms state-of-the-art methods in biomedical machine reading for precision oncology by 20 absolute F1 points. |
Learning from Noisy Labels for Entity-Centric Information Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent information extraction approaches can easily overfit noisy labels and suffer from performance degradation. |
| Approach: | They propose a co-regularization framework for entity-centric information extraction that optimizes neural models with task-specific losses and regularizes them to generate similar predictions based on agreement loss. |
| Outcome: | The proposed framework is optimized with task-specific losses and generates similar predictions based on agreement loss. |
Leveraging Structured Information for Explainable Multi-hop Question Answering and Reasoning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Neural models, including large language models (LLMs), achieve superior performance on multi-hop question-answering tasks. |
| Approach: | They propose to use the chain-of-thought mechanism to generate both the reasoning chain and the answer. |
| Outcome: | Empirical results show that the proposed framework generates more faithful reasoning chains and significantly improves the QA performance on two benchmark datasets. |
Domain Knowledge Empowered Structured Neural Net for End-to-End Event Temporal Relation Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to extract event temporal relations from text data are limited by hard constraints and large datasets. |
| Approach: | They propose a framework that enhances deep neural network with distributional constraints constructed by probabilistic domain knowledge to improve the baseline neural network models. |
| Outcome: | The proposed framework improves baseline models with strong statistical significance on two widely used datasets in news and clinical domains. |
Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Entity and Relation Extraction (ERE) is an important task in information extraction. |
| Approach: | They propose a hypergraph neural network for ERE built upon the PL-marker . they use a pruner mechanism to transfer the burden of entity identification to the joint module . |
| Outcome: | The proposed model improves on three widely used benchmarks on ERE task . it uses a pruner mechanism to transfer the burden of entity identification to the joint module . |
Recovering Patient Journeys: A Corpus of Biomedical Entities and Relations on Twitter (BEAR) (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing medical social media corpora focus on a small set of entities and relations . existing text mining and information extraction methods focus on scientific text generated by researchers but their access to individual patient experiences or patient-doctor interactions is limited. |
| Approach: | The dataset consists of 2,100 medical tweets with approx. 6,000 entities and 2,200 relations. |
| Outcome: | The proposed dataset consists of 2,100 tweets with approx. 6,000 entities and 2,200 relations. |
Entity Linking over Nested Named Entities for Russian (2022.lrec-1)
Copied to clipboard
Natalia Loukachevitch, Pavel Braslavski, Vladimir Ivanov, Tatiana Batura, Suresh Manandhar, Artem Shelmanov, Elena Tutubalina
| Challenge: | Entity linking is a popular NLP task, where a system needs to link a named entity to a concept in a knowledge base such as Wikidata. |
| Approach: | They describe the main design principles behind entity linking annotation in the recently released Russian NEREL dataset for information extraction. |
| Outcome: | The NEREL dataset is the largest Russian dataset annotated with entities and relations. |
QA4IE: A Quality Assurance Tool for Information Extraction (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing tools for data annotation do not provide comprehensive support for quality assurance. |
| Approach: | They propose a QA tool for information extraction that detects potential problems in text annotations in a timely manner and accurately assesses the quality of annotations. |
| Outcome: | The proposed tool can detect potential problems in text annotations in a timely manner, accurately assess the quality of annotations, and visually display and summarize annotation discrepancies among annotation team members. |
EventRelBench: A Comprehensive Benchmark for Evaluating Event Relation Understanding in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing LLMs fail to capture event relationships, despite advances in NLP . a new benchmark is being developed to assess LLM's ability to extract event relationships . |
| Approach: | They propose a benchmark to assess LLMs' ability to extract event relations . EventRelBench comprises 35K diverse event relation questions . |
| Outcome: | The benchmark EventRelBench measures the performance of large language models on event relation extraction tasks. |
PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple Extraction (2021.acl-long)
Copied to clipboard
Hengyi Zheng, Rui Wen, Xi Chen, Yifan Yang, Yunyan Zhang, Ziheng Zhang, Ningyu Zhang, Bin Qin, Xu Ming, Yefeng Zheng
| Challenge: | Recent methods for extracting entities and relations from unstructured texts suffer from limitations, such as redundancy of relation prediction and inefficiency. |
| Approach: | They propose a joint relational triple extraction framework based on Potential Relation and Global Correspondence (PRGC) they propose overlapping triples for relation prediction and relation-relational alignment . |
| Outcome: | The proposed framework achieves state-of-the-art performance on public benchmarks with higher efficiency and consistent performance gain on complex scenarios of overlapping triples. |
Selecting and Merging: Towards Adaptable and Scalable Named Entity Recognition with Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to align large language models with information extraction tasks are costly and not all training data benefits target domains. |
| Approach: | They propose a framework which dynamically Selects and Merges expert models at inference time and combines experts beneficial to target domains. |
| Outcome: | The proposed framework outperforms the unified model by 10% on multiple benchmarks. |
Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for information extraction from biomedical texts do not utilize external knowledge . despite the exponential growth of biomedically published articles, many existing methods fall behind . |
| Approach: | They propose a framework that utilizes external knowledge for entity and relation extraction . KECI uses an initial span graph to construct a knowledge graph containing relevant background knowledge . |
| Outcome: | The proposed framework achieves state-of-the-art results in two biomedical datasets . it achieves 4.59% and 4.91% improvement in F1 scores over the state- of-the art methods . |
Beyond Word Boundaries: A Hebrew Coreference Benchmark and an Evaluation Protocol for Morphologically Complex Text (2026.acl-long)
Copied to clipboard
| Challenge: | CR methods originally designed for English struggle with Morphologically Rich Languages (MRLs) a single token in Hebrew may consist of multiple anaphors, and word/morpheme boundary discrepancies make mention detection and coreference resolution difficult in MRLs. |
| Approach: | They propose a CR dataset that identifies mentions at word, sub-word and multi-word levels and an evaluation protocol that directly addresses word/morpheme boundary discrepancies. |
| Outcome: | The proposed evaluation protocol directly addresses word/morpheme boundary discrepancies in Modern Hebrew, an MRL rich with complex words and pronominal clitics. |
TabPrompt: Graph-based Pre-training and Prompting for Few-shot Table Understanding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods of Table Understanding (TU) focus on the textual content within the tabular data, disregarding the topological information of the table. |
| Approach: | They propose a framework that uses tabs to understand tabular data without ignoring the topological information of the table. |
| Outcome: | The proposed framework outperforms baselines in few-shot table understanding tasks. |
A Dataset for Multi-lingual Epidemiological Event Extraction (2020.lrec-1)
Copied to clipboard
| Challenge: | Using the Web, we propose a corpus for information extraction and text classification. |
| Approach: | They propose to use a corpus for information extraction and natural language processing (NLP) tasks such as text classification. |
| Outcome: | The proposed corpus can be used for information extraction and natural language processing tasks such as text classification. |
Query-based Instance Discrimination Network for Relational Triple Extraction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent approaches to extract relational triples from open domain texts suffer from error propagation, relation redundancy and lack of high-level connections. |
| Approach: | They propose a query-based approach to construct instance-level representations for relational triples . they use query embeddings and token embeddables to extract all types of triples in one step . |
| Outcome: | The proposed method achieves state-of-the-art on five widely used benchmarks. |
Constructing a Lexicon of Relational Nouns (L18-1)
Copied to clipboard
| Challenge: | Existing systems for extracting relations expressed using nouns do not exist for relational noun. |
| Approach: | They contribute a lexicon of 6,224 labeled nouns which includes 1,446 relational noun. |
| Outcome: | The proposed classifier achieves 70.4% F1 on held out nouns among the most common 2,500 word types in Gigaword. |
Combining rule-based and embedding-based approaches to normalize textual entities with an ontology (L18-1)
Copied to clipboard
| Challenge: | a method to normalize multi-word terms with concepts from a domain-specific ontology is proposed . a large part of knowledge is expressed in textual form, such as in scientific articles . |
| Approach: | They propose a method to normalize multi-word terms with concepts from a domain-specific ontology. |
| Outcome: | The proposed method outperforms existing methods on a categorization task in bacterial habitats . the results are encouraging, and the proposed method is expected to be widely used in the biomedical/biological field . |
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark (2022.acl-long)
Copied to clipboard
Ningyu Zhang, Mosha Chen, Zhen Bi, Xiaozhuan Liang, Lei Li, Xin Shang, Kangping Yin, Chuanqi Tan, Jian Xu, Fei Huang, Luo Si, Yuan Ni, Guotong Xie, Zhifang Sui, Baobao Chang, Hui Zong, Zheng Yuan, Linfeng Li, Jun Yan, Hongying Zan, Kunli Zhang, Buzhou Tang, Qingcai Chen
| Challenge: | a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages. |
| Approach: | They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models. |
| Outcome: | The proposed benchmarks show that the current models perform worse than the human ceiling. |
Enriching a Time-Domain Astrophysics Corpus with Named Entity, Coreference and Astrophysical Relationship Annotations (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing corpora for astrophysical natural language processing are limited to Named Entity Recognition tasks, leaving a gap in resource diversity. |
| Approach: | They propose to expand astroECR to cover named entities, coreferences, annotations related to aastrphysical relationships, and normalizing celestial object names. |
| Outcome: | The proposed model extends the time-domain astrophysics corpus to include named entities, coreferences, and annotations related to aastrphysical relationships. |
GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasets (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) models are crucial for academic writing . existing ground truth datasets do not treat fine-grained types like ML model and model architecture as separate entity types . |
| Approach: | They propose to annotate 100 full-text scientific publications and a first baseline model for 10 entity types centered around ML models and datasets. |
| Outcome: | The proposed model can be used to identify 10 entity types in scientific articles . existing models cannot recognize fine-grained models like ML models and model architecture . |
Czech Historical Named Entity Corpus v 1.0 (2020.lrec-1)
Copied to clipboard
| Challenge: | a lack of annotated historical data for named entity recognition is an obstacle to research in this area. |
| Approach: | They propose to create an annotated corpus for named entity recognition in historical documents . they define domain-specific named entity types and create an annotation manual . |
| Outcome: | The proposed corpus is available for research and is available to download . it is the first annotated historical corpus for named entity recognition (NER) |
Evaluating Generative Language Models in Information Extraction as Subjective Question Correction (2024.lrec-main)
Copied to clipboard
| Challenge: | Modern large language models (LLMs) perform poorly in elementary tasks like relation extraction and event extraction due to two issues in conventional evaluation methods. |
| Approach: | They propose a method to evaluate large language models by incorporating a human annotation schema. |
| Outcome: | The proposed evaluation method improves matching between model outputs and golden labels. |
WebDART: Dynamic Decomposition and Re-planning for Complex Web Tasks (2026.findings-acl)
Copied to clipboard
| Challenge: | Large-language-model (LLM) agents are competent at straightforward web tasks, but struggle with complex tasks. |
| Approach: | They propose a general framework that decomposes web tasks into three subtasks . they show that WebDART lifts end-to-end success rates by 13.7 percentage points . |
| Outcome: | Evaluated on WebChoreArena, WebDART lifts success rates by 13.7 percentage points over previous state-of-the-art agents. |
Annotated Corpus of Scientific Conference’s Homepages for Information Extraction (L18-1)
Copied to clipboard
| Challenge: | a corpus of scientific conferences contains homepages with annotations of important information . name of conference, abbreviation, place, submission, notification, camera ready dates are included . |
| Approach: | They propose a corpus that contains 943 homepages of scientific conferences with annotations of interesting information. |
| Outcome: | The proposed corpus contains 943 homepages of scientific conferences, 14794 including subpages . the results show that it can be used as a reference data set for this type of task. |
C-ICL: Contrastive In-context Learning for Information Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for in-context learning with large language models focus on using correct or negative examples, ignoring the potential value of incorrect or negative samples. |
| Approach: | They propose a few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations. |
| Outcome: | The proposed technique outperforms previous few-shot in-context learning methods on a broad spectrum of related tasks. |
Schema-Driven Information Extraction from Heterogeneous Tables (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on information extraction from tables has focused on developing custom pipelines for each table collection. |
| Approach: | They propose a task that transforms tabular data into structured records following a human-authored schema. |
| Outcome: | The proposed task achieves F1 scores ranging from 74.2 to 96.1 while maintaining cost efficiency. |
Is There a One-Model-Fits-All Approach to Information Extraction? Revisiting Task Definition Biases (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Definition bias is a negative phenomenon that can mislead models. |
| Approach: | They propose a framework that measures definition bias, bias-aware fine-tuning and task-specific bias mitigation to mitigate definition bias in information extraction. |
| Outcome: | The proposed framework mitigates definition bias in information extraction tasks by measuring definition bias, bias-aware fine-tuning, and task-specific bias mitigation. |
Instruct and Extract: Instruction Tuning for On-Demand Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models with instruction-following capabilities are not suitable for long-tail ad hoc extraction use cases for non-expert users. |
| Approach: | They propose a task that follows instructions to extract the desired content from the associated text and present it in a structured tabular format. |
| Outcome: | The proposed paradigm outperforms existing open-source models of similar size in terms of information extraction. |
Event Extraction in Video Transcripts (2022.coling-1)
Copied to clipboard
| Challenge: | Existing EE datasets are limited to formally written documents such as news articles or scientific papers . existing EE methods and datasets cannot be used in informal and noisy texts . |
| Approach: | They propose to use video transcripts as a dataset for event extraction . they demonstrate that existing state-of-the-art EE methods cannot achieve adequate performance . |
| Outcome: | The proposed dataset evaluates state-of-the-art EE methods on streamed videos on Behance . it shows that such systems cannot achieve adequate performance on the proposed dataset . |
Learning Cross-Task Dependencies for Joint Extraction of Entities, Events, Event Arguments, and Relations (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on IE tasks that use two types of dependencies is not optimal . emr, event trigger detection, event argument extraction, and relation extraction are challenging . |
| Approach: | They propose a model that learns cross-task dependencies from data . they treat each task instance as a node in a dependency graph . |
| Outcome: | The proposed model outperforms strong baselines over four datasets with different languages. |
Constrained Tuple Extraction with Interaction-Aware Network (2023.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge triples lack constraints for their authenticity due to spatial, temporal, or other constraints. |
| Approach: | They propose a constrained tuple extraction task to guarantee the validity of knowledge tifles by using an interaction-aware network to extract constrained text. |
| Outcome: | The proposed model outperforms existing models on the dataset and the public CaRB dataset. |
A Survey on MLLM-based Visually Rich Document Understanding: Methods, Challenges, and Emerging Trends (2026.findings-acl)
Copied to clipboard
Yihao Ding, Siwen Luo, Yue Dai, Yanbei Jiang, Zechuan Li, Qiang Sun, Geoffrey Martin, Wei Liu, Yifan Peng
| Challenge: | Visually Rich Document Understanding (VRDU) frameworks are a key area of research . early approaches to VRDU relied on manually crafted rules and domain-specific heuristics . conventional deep learning approaches do not integrate the diverse modalities in documents . |
| Approach: | They review recent advances in MLLM-based Visually Rich Document Understanding (VRDU) their findings highlight emerging trends and promising research directions . |
| Outcome: | The proposed frameworks are scalable, reliable, and adaptable, the authors argue . their findings highlight emerging trends and promising research directions . |
From Examples to Rules: Neural Guided Rule Synthesis for Information Extraction (2022.lrec-1)
Copied to clipboard
Robert Vacareanu, Marco A. Valenzuela-Escárcega, George Caique Gouveia Barbosa, Rebecca Sharp, Gustave Hahn-Powell, Mihai Surdeanu
| Challenge: | a "deep learning tsunami" has brought tremendous improvements in performance to most NLP applications. |
| Approach: | They propose a method for rule synthesis from examples that combines the advantages of deep learning and rule-based methods. |
| Outcome: | The proposed method achieves state-of-the-art on 1-shot task and competitive performance in 5-shot scenario. |
Enhancing Relation Extraction via Adversarial Multi-task Learning (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing studies have focused on re-modeling the given NEs and thus lead to inferior results when NE is sometimes ambiguous. |
| Approach: | They propose a relation extraction model with two training stages that uses adversarial multi-task learning to recover the given NEs. |
| Outcome: | The proposed model improves on two English benchmark datasets and shows state-of-the-art performance. |
Entity-centered Cross-document Relation Extraction (2022.emnlp-main)
Copied to clipboard
Fengqi Wang, Fei Li, Hao Fei, Jingye Li, Shengqiong Wu, Fangfang Su, Wenxuan Shi, Donghong Ji, Bo Cai
| Challenge: | Existing methods for relation extraction only use text snippets surrounding target entities in multiple documents. |
| Approach: | They propose a relation-extraction model that uses cross-path entity relation attention to detect the semantic relations between entities in a given text. |
| Outcome: | The proposed method outperforms the state-of-the-art methods in the dataset CodRED by 10%. |
Grammar-Constrained Decoding for Structured NLP Tasks without Finetuning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing grammar-constrained decoding methods are limited to specific tasks . a grammar constraint is used to control the generation of LMs, but it is limited to a few tasks a task is not performed. |
| Approach: | They propose grammar-constrained decoding to control the generation of large language models . they demonstrate that grammars can describe the output space for a wider range of tasks . |
| Outcome: | The proposed grammars outperform unconstrained models on information extraction, entity disambiguation, and constituency parsing. |
Open Terminology Management and Sharing Toolkit for Federation of Terminology Databases (2022.lrec-1)
Copied to clipboard
| Challenge: | Terminology is also needed in AI applications such as machine translation, speech recognition, information extraction, and other natural language processing tools. |
| Approach: | They propose a terminology management solution that facilitates standards-based sharing and management of terminology resources by providing the EuroTermBank Toolkit. |
| Outcome: | The EuroTermBank Toolkit facilitates standards-based sharing and management of terminology resources by participating in federated databases. |
A Simple Contrastive Learning Framework for Interactive Argument Pair Identification via Argument-Context Extraction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on argument mining uses context-based methods to identify whether two arguments are interactively related. |
| Approach: | They propose a contrastive learning framework to extract valuable information from the context. |
| Outcome: | The proposed framework achieves state-of-the-art performance on the benchmark dataset and visually displays more compact representations. |
NCRE: A Benchmark for Document-level Nominal Compound Relation Extraction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing work focuses on detecting specific relations between entities, often constrained to specific fields and lacking general applicability. |
| Approach: | They propose a novel task that concentrates on abstract relation extraction between noun phrases . they annotate a Chinese dataset and develop a model incorporating a rotary position-enhanced word pair detection schema. |
| Outcome: | The proposed task is more efficient than previous methods. |
MARIO-0.5B: A Multi-Agent Lightweight Model for Real-Time Open Information Extraction in Low-Resource Settings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have shown remarkable capabilities in open information extraction, but their resource requirements often restrict their deployment in resource-constrained industrial settings. |
| Approach: | They introduce an ultra-lightweight large language model trained on instruction-based samples in Chinese, English, Korean, and Russian. |
| Outcome: | The proposed model outperforms large-scale models with up to 70B parameters, reducing computational resources by 140x and delivering 11x faster response times. |
NegBERT: A Transfer Learning Approach for Negation Detection and Scope Resolution (2020.lrec-1)
Copied to clipboard
| Challenge: | Negation is an important characteristic of language, and a major component of information extraction from text. |
| Approach: | They propose to use a popular transfer learning model to solve Negation Detection and Scope Resolution tasks in 3 datasets that have gained popularity over the years. |
| Outcome: | The proposed model outperforms existing systems on the BioScope Corpus, the Sherlock dataset and the SFU Review Corpus in scope resolution. |
Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples! (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models have made remarkable strides in various tasks, but whether they are competitive few-shot solvers remains an open question. |
| Approach: | They propose an adaptive filter-then-rerank paradigm to combine the strengths of LLMs and SLMs. |
| Outcome: | The proposed system achieves promising improvements on various IE tasks with acceptable time and cost investment. |
ZeroShotCeres: Zero-Shot Relation Extraction from Semi-Structured Webpages (2020.acl-main)
Copied to clipboard
| Challenge: | Existing work on information extraction from semi-structured websites has relied on manual data annotation and learning a model specific to a given template. |
| Approach: | They propose a solution for “zero-shot” open-domain relation extraction from webpages with previously unseen templates using a graph neural network-based approach. |
| Outcome: | The proposed model provides a 31% gain over baseline for zero-shot extraction in a new subject vertical. |
DiSCoMaT: Distantly Supervised Composition Extraction from Tables in Materials Science Articles (2023.acl-long)
Copied to clipboard
| Challenge: | Advanced knowledge of a science or engineering domain is typically found in domain-specific research papers. |
| Approach: | They propose a task of extracting compositions of materials from tables in materials science papers to facilitate research in this direction. |
| Outcome: | The proposed model outperforms previous table processing architectures by significant margins. |
Exploring LLM Annotation for Adaptation of Clinical Information Extraction Models under Data-sharing Restrictions (2025.findings-acl)
Copied to clipboard
| Challenge: | In-hospital text data often contains valuable clinical information, yet fine-tuned small language models (SLMs) for information extraction remain challenging due to differences in formatting and vocabulary across institutions. |
| Approach: | They leverage large language models to annotate the target domain data for adaptation . they use in-hospital text data to extract clinical information . |
| Outcome: | The proposed model outperforms manual annotation on four clinical information extraction tasks with a larger number of annotated data. |
Hopping Too Late: Exploring the Limitations of Large Language Models on Multi-Hop Queries (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) can solve complex multi-step problems, but little is known about how these computations are implemented internally. |
| Approach: | They propose a "back-patching" analysis method to solve multi-hop queries . they propose resolving the bridge entity into the bridge and the second hop into the target entity into latent steps. |
| Outcome: | The proposed method solves multi-hop queries that require two information extraction steps . it shows that the later layers lack the necessary knowledge to correctly generate the answer . |
DiZiNER: Disagreement-guided Instruction Refinement via Simulating Pilot Annotation for Zero-shot Named Entity Recognition (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models have advanced information extraction (IE) by enabling zero-shot and few-shot named entity recognition (NER) but their outputs still show persistent and systematic errors. |
| Approach: | They propose a framework that simulates the pilot annotation process and employs LLMs as both annotators and supervisors to refine model disagreements. |
| Outcome: | Using a pilot annotation process, the proposed framework outperforms its supervisor model on 18 benchmarks. |
Looking Right is Sometimes Right: Investigating the Capabilities of Decoder-only LLMs for Sequence Labeling (2024.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models excel in natural language understanding (NLU) tasks. |
| Approach: | They propose to apply layer-dependent removal of the causal mask (CM) during LLM fine-tuning to improve SL performance. |
| Outcome: | The proposed approach outperforms state-of-the-art SL models on IE tasks, while achieving state- of-the art results is unclear. |
KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completion (2024.lrec-main)
Copied to clipboard
| Challenge: | Knowledge graph completion (KGC) is a critical task to predict missing facts among entities. |
| Approach: | They propose a knowledge-constrained generative re-ranking method based on generative large language models for KGC that can predict missing facts among entities. |
| Outcome: | The proposed method achieves state-of-the-art performance on four datasets and 9.0% and 11.1% compared to the previous methods. |
Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in multimodal pre-trained models have significantly improved information extraction from visually-rich documents (VrDs). |
| Approach: | They propose a method to predict token sequences within visually-rich documents by a simple prediction head. |
| Outcome: | The proposed method can be used to predict token mentions as token sequences within documents. |
Efficient Overshadowed Entity Disambiguation by Mitigating Shortcut Learning (2024.emnlp-main)
Copied to clipboard
Panuthep Tasawong, Peerat Limkonchotiwat, Potsawee Manakul, Can Udomcharoenchaikit, Ekapol Chuangsuwanich, Sarana Nutanong
| Challenge: | Entity disambiguation (ED) is crucial in natural language processing tasks such as question-answering and information extraction. |
| Approach: | They propose a method to reduce computational overhead on overshadowed entities by addressing shortcut learning. |
| Outcome: | The proposed method achieves state-of-the-art performance without compromising inference speed. |
CodeIE: Large Code Generation Models are Better Few-Shot Information Extractors (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models pre-trained on massive corpora have shown impressive few-shot learning ability on many NLP tasks. |
| Approach: | They propose to recast structured output in the form of code instead of natural language and use generative LLMs of code to perform IE tasks. |
| Outcome: | The proposed method outperforms fine-tuning moderate-size pre-trained models and prompting NL-LLMs under few-shot settings. |
On Event Individuation for Document-Level Information Extraction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a bomb exploded in a restaurant in Lima, and a second device was deactivated by the police . |
| Approach: | They argue that the task demands definitive answers to thorny questions of *event individuation* they argue that even human experts disagree on the task . |
| Outcome: | The proposed task demands definitive answers to thorny questions of *event individuation* . the proposed task also raises concerns about the usefulness of template filling metrics . |
Recognizing Everything from All Modalities at Once: Grounded Multimodal Universal Information Extraction (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on IE tasks have focused on recognizing and analyzing cross-modal information . a multimodal large language model (MLLM) is developed to analyze IE across modalities . |
| Approach: | They propose a multimodal large language model (MLLM) capable of grounding information from all modalities. |
| Outcome: | The proposed framework provides a framework to analyze IE tasks over various modalities and their fine-grained groundings. |
From Speculation Detection to Trustworthy Relational Tuples in Information Extraction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on speculation detection are defined at sentence level, but not all factual tuples extracted from a sentence are speculative. |
| Approach: | They propose to study speculations in OIE tuples and determine whether a tample is speculative. |
| Outcome: | The proposed model is based on the LSOIE dataset and provides labels for speculative tuples. |
LayoutLLM: Large Language Model Instruction Tuning for Visually Rich Document Understanding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to enhance document comprehension require fine-tuning for each task and dataset, and are expensive to train and operate. |
| Approach: | They propose a more flexible document analysis method that integrates visual-rich document understanding with large-scale language models (LLMs) by leveraging existing research in document image understanding and LLMs’ superior language understanding capabilities, the proposed model performs an understanding of document images in a single model. |
| Outcome: | The proposed model improves on the baseline model in document image understanding tasks. |
Problem Solved? Information Extraction Design Space for Layout-Rich Documents using LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new open-source layout-aware IE test suite is available for download at https://github.com/gayecolakoglu/layIE-LLM. |
| Approach: | They propose an open-source layout-aware IE test suite that provides a layout-based IE pipeline. |
| Outcome: | The proposed method achieves 13.3–37.5 F1 points more than a baseline configuration using the same LLM. |
Document-level Causal Relation Extraction with Knowledge-guided Binary Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research on Event-Event Causal Relation Extraction (ECRE) has highlighted the lack of document-level modeling and causal hallucinations. |
| Approach: | They propose a Knowledge-guided binary Question Answering method with event structures for ECRE that utilizes cross-task knowledge in IE. |
| Outcome: | The proposed method achieves state-of-the-art on the MECI and MAVEN-ERE datasets. |
Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for Continual Learning (CL) have limited KT and catastrophic forgetting . a new method overcomes CF by isolating the knowledge of each task . |
| Approach: | They propose a method to overcome catastrophic forgetting and encourage knowledge transfer . they propose to discover a sub-network for each task and a soft-masking mechanism to preserve the previous knowledge. |
| Outcome: | The proposed method outperforms baselines in classification, generation, information extraction and their mixture. |
Calibrated Seq2seq Models for Efficient and Generalizable Ultra-fine Entity Typing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | CASENT predicts ultra-fine entities mentioned in text into types with calibrated confidence scores. |
| Approach: | They propose a model that predicts ultra-fine entities with calibrated confidence scores for entity typing. |
| Outcome: | The proposed model outperforms existing models in terms of F1 score and calibration error while achieving 50 times faster inference speed. |
On the Use of Silver Standard Data for Zero-shot Classification Tasks in Information Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing zero-shot methods for information extraction use large amounts of gold standard data. |
| Approach: | They propose a framework to utilize silver data to enhance zero-shot classification methods . they propose to use off-the-shelf models of other NLP tasks to perform inference on test data . |
| Outcome: | The proposed framework outperforms baseline methods on TACRED and Wiki80 datasets by 5% and 6% on the zero-shot relation classification task and by 3% 7 % on Smile (Korean and Polish) |
MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation (2025.acl-long)
Copied to clipboard
Haochen Xue, Feilong Tang, Ming Hu, Yexin Liu, Qidong Huang, Yulong Li, Chengzhi Liu, Zhongxing Xu, Chong Zhang, Chun-Mei Feng, Yutong Xie, Imran Razzak, Zongyuan Ge, Jionglong Su, Junjun He, Yu Qiao
| Challenge: | Existing multimodal large language models lack the ability to memorize, recall, and reason in sustained interactions. |
| Approach: | They propose a multimodal real-world conversation benchmark for evaluating open-ended abilities of multimodal large language models. |
| Outcome: | The proposed benchmarks show that the models perform better in open-ended conversations. |
PolyNERE: A Novel Ontology and Corpus for Named Entity Recognition and Relation Extraction in Polymer Science Domain (2024.lrec-main)
Copied to clipboard
| Challenge: | a new ontology for polymer-relevant entities and relations is available for training data . the ontologies are customizable to adapt to specific research needs. |
| Approach: | They propose a polymer-relevant ontology featuring crucial entities and relations . the ontologies are customizable to adapt to specific research needs . |
| Outcome: | The proposed ontology can extract polymer-relevant information from scientific papers . it can be customized to adapt to specific research needs . |
ToMMeR - Efficient Entity Mention Detection from Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods to detect text spans that refer to entities are often conflated with entity typing in a single joint task. |
| Approach: | They propose a lightweight model that probes mention detection capabilities from early LLM layers. |
| Outcome: | The proposed model achieves 93% recall zero-shot with 90% precision under human-calibrated LLM-judge protocol . |
WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation (2025.emnlp-main)
Copied to clipboard
Rabiul Awal, Mahsa Massoud, Aarash Feizi, Zichao Li, Suyuchen Wang, Christopher Pal, Aishwarya Agrawal, David Vazquez, Siva Reddy, Juan A. Rodriguez, Perouz Taslakian, Spandana Gella, Sai Rajeswar
| Challenge: | Existing benchmarks focus on specific aspects of web tasks but lack comprehensive coverage. |
| Approach: | They propose a multilingual benchmark that evaluates three core web tasks: (1) website visual question answering, (2) code editing involving HTML/CSS/JavaScript, and (3) mockup-to-code generation. |
| Outcome: | The proposed model performs well on basic information extraction, but struggles with reasoning and grounding, editing code to preserve functionality, and generating design-to-code that maintains hierarchy and supports multilingual content. |
Summary Factual Inconsistency Detection Based on LLMs Enhanced by Universal Information Extraction (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that Large language models can detect factual inconsistencies in summaries but they lack the efficiency and explainability needed to be effective. |
| Approach: | They propose to decouple LLMs’ information extraction and reasoning capabilities to address key challenges and propose a framework for UIEFID to guide fine-tuned LLM methods in extracting unified structured information from documents and summaries. |
| Outcome: | The proposed framework improves the detection accuracy and reduces redundant reasoning on the AGGREFACT benchmark. |
Spanless Event Annotation for Corpus-Wide Complex Event Understanding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for annotating multilingual, multimedia data are limited by the availability of multilingual corpora for schema-based event representation. |
| Approach: | They propose a new approach to event annotation to promote whole-corpus understanding of complex events in multilingual, multimedia data. |
| Outcome: | The proposed method is part of the DARPA Knowledge-directed Artificial Intelligence Reasoning Over Schemas (KAIROS) Program. |
Text2Story Lusa: A Dataset for Narrative Analysis in European Portuguese News Articles (2024.lrec-main)
Copied to clipboard
Sérgio Nunes, Alípio Mario Jorge, Evelin Amorim, Hugo Sousa, António Leal, Purificação Moura Silvano, Inês Cantante, Ricardo Campos
| Challenge: | Access to annotated corpora with narrative elements is limited due to the lack of readily available datasets and copyright concerns. |
| Approach: | They developed a dataset that contains 357 news articles and 117 manually annotated articles with over 50 thousand individual annotations. |
| Outcome: | The proposed datasets are available in English and Portuguese and are based on 117 articles totaling over 50 thousand individual annotations. |
Map&Make: Schema Guided Text to Table Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text-to-table generation overlook what complex information to extract and how to infer it from text. |
| Approach: | They propose a method that decomposes text into atomic propositions to infer latent schemas. |
| Outcome: | The proposed method shows significant gains in accuracy and interpretability on three datasets. |
UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies rely on shallow unsupervised data generated by token surface matching regardless of global context-aware semantics of the surrounding text tokens. |
| Approach: | They propose an Unsupervised Pseudo Semantic Data Augmentation mechanism to enrich training data without human intervention. |
| Outcome: | The proposed model improves on general zero-shot cross-lingual understanding tasks on different languages without human intervention. |
BCL: Bayesian In-Context Learning Framework for Information Extraction (2026.findings-acl)
Copied to clipboard
Haoliang Liu, Chengkun Cai, Xu Zhao, Han Zhu, Shizhou Huang, Xinglin Zhang, Tao Chen, Jenq-Neng Hwang, Zhang Huaping, Lei Li
| Challenge: | Existing information extraction (IE) tasks rely on in-context learning with large language models. |
| Approach: | They propose a Bayesian-based in-context learning framework that refines label representations across IE tasks using particle filtering and Bayes updates. |
| Outcome: | The proposed framework improves performance over existing methods (up to 30%) it underperforms one-shot prompting by a substantial margin on NER tasks and CodeIE fails on RE tasks with near-zero micro-F1. |
Introducing Spotlight: A Novel Approach for Generating Captivating Key Information from Documents (2025.emnlp-main)
Copied to clipboard
Ankan Mullick, Sombit Bose, Rounak Saha, Ayan Kumar Bhowmick, Aditya Vempaty, Prasenjit Dey, Ravi Kokku, Pawan Goyal, Niloy Ganguly
| Challenge: | Unlike highlights (fragmented key points) and traditional summaries, spotlights selectively emphasize intriguing content to foster deeper reader engagement with the source material. |
| Approach: | They propose a novel paradigm for information extraction that selectively emphasizes intriguing content to foster deeper reader engagement with the source material. |
| Outcome: | The proposed model improves readability and boosts engagement value of the original document. |
AnchorAlign: A Novel Anchor Alignment-enhanced Generative Method for Joint Named Entity Recognition and Relation Extraction (2026.findings-acl)
Copied to clipboard
| Challenge: | Named Entity Recognition and Relation Extraction are interdependent tasks in information extraction. |
| Approach: | They propose a generative method enhanced by anchor alignment to bridge NER and RE tasks . they use anchor entities as semantic pivots to align the two tasks based on their semantic representations . |
| Outcome: | The proposed method outperforms state-of-the-art models on five benchmark datasets. |
Prompt Optimization for Relation Extraction using Reinforcement Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing prompt-based methods rely heavily on large-scale annotated datasets limiting their applicability in domain-specific and low-resource scenarios. |
| Approach: | They propose a reinforcement learning-based automated prompt optimization framework for domain relation extraction that optimizes prompt quality through interaction with a black-box LLM. |
| Outcome: | The proposed framework outperforms existing prompt-based methods and supervised baselines on multiple extraction datasets across medical, financial, legal, and news domains. |
From Recognition to Reasoning: Benchmarking and Enhancing MLLMs on Real-World Receipt Document Understanding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models for visual information extraction suffer from limitations in scale and realism . ReceiptBench is a large-scale, human-annotated benchmark for receipts . |
| Approach: | They propose a large-scale, human-annotated benchmark for visual information extraction . the method organizes information extraction into four hierarchical sub-tasks . |
| Outcome: | The proposed method surpasses proprietary models on complex reasoning tasks. |